Articulated Manipulator for Visually Impaired People (AMVIP)

Assistive technology for visually impaired (VI) people has recently received tremendous attention in the industry: from a start-up to a multinational corporation. However, these efforts mostly concentrate in self-localization and guidance to specific destinations in a verbal format, but are unaware of other communication channels (i.e.: languages). A desire to help a VI individual communicating confidently with people having other disabilities is the main purpose of this project. The project aims to introduce an articulate manipulator for visually impaired people (AMVIP) that takes input as a sign language and outputs Braille characters for VI people. In the scope of kinematics in robotics and gesture recognition in computer vision, this report mainly focuses on spatial transformations, manipulator forward kinematics, manipulator inverse kinematics, and the control algorithm; including a 3D pose localization and gesture recognition.